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PROGRAM CONVERSION APPARATUS AND METHOD 
AS WELL AS RECORDING MEDIUM 

BACKGROUND OF TH E INVENTION 
3 Field of the Inventi on 

The present invention relates to a program conversion 
apparatus and method for a mult i- thread type microprocessor 
which can execute a plurality machine instructions 
simultaneously, and more particularly to a program conversion 
10 apparatus and method for producing a parallel program which 
exhibits a high execution efficiency although the granularity 
is low. 

Description of the Relate d Art 

A multi-thread execution technique wherein a program is 
15 divided into a plux-ality of instruction flows , that is , threads 
and executing the threads parallelly is conventionally adopted 
as one of techniques for raising the execution performance of 
a program by an information processing apparatus. 

A multi- thread microprocessor including a plurality of 
20 processor elements each having an execution unit and coupled 
closely to each other has a characteristic that processing such 
as creation and synchronization of threads can be performed 
at a low cost , and can exhibit a sufficient parallel processing 
effect even with: a program which is high in sequential property 
25 and low in granularity (size of a thread). 

Various architectures for such a multi-thread 
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microprocessor as described above are known and disclosed, for 
example, in the following documents: 

Document 1: Torii et si., "Control Parallel On-Chip 
Multi -processor: MUSCAT" , JSPP'97 Joint Symposium on Parallel 
Processing 1997, the Informat ion Processing Snni ety of Japan, 
pp. 229-236, May, 1997 

Document 2: Torii et all, "On-chip Control Parallel 
Multi-processor: MUSCAT", IPS J TRANSACTION, Vol. 39, No. 6, 
June, 1998 

Document 3: Japanese Patent Laid-Open No. 78880/1998 
First, the MUSCAT architecture disclosed in Document 2 
above is described. The MUSCAT ia an architecture wherein a 
plurality of processor elements are integrated on one chip and 
efficiently execute multi-thread processing called "control 
parallel'. Each processor element has an independent 
functional unit and an independent register set. On the other 
hand, the processor elements share a memory space. 

A control parallel execution method of the MUSCAT is 
described. Bach processor element of the MUSCAT architecture 
has a FORK instruction for generation of a thread and can create 
a new thread in an adjacent processor el ement using one machine 
instruction. 

The MUSCAT adopts a "fork once model" for limiting the 
number of times by which one thread can execute the FORK 
instruction to one to the utmost. The processor elements are 
coupled in a one - direct ional ring , and if a thread being executed 



by a certain one of the processor elements executes the FORK 
instruction, then a new thread is created in another processor 
element ad] acent on the downstream si de . If the thread executes 
a term instruction (thread ending instruction) , then the thread 
ends itself. 

Transfer of data between processor elements is performed 
through a register or a memory. If the PORK instruction is 
executed, then contents of the register set of the processor 
element by which the thread (called "parent thread") is being 
executed are logically copied into the register set of another 
processor element which i s r.n execiite the newly generated thread 
(called "child thread" ) . Further, a value stored intu a memory 
by Lhe parent thread before the KOKK instruction is executed 
can be loaded into and referred to by the child thread. 

The only method by whi ch the parent thread delivers data 
to the child thread after the parent thread generates Lhe child 
thread is to deliver data through a memory. In this instance, 
in order to execute store of the parent thread and load uf Lhe 
child thread in a correct execution order, they must be in a 
kind of synchronism with each other . A countermeasure for such 
synchronization is called "data dependence assurance". 

The MUSCAT provides the following two systems for the 
data dependence assurance: 

1. BLOCK ■ system wherein synchronism is explicitly 
declared in advance; and 

2. DSP system wherein the data dependence assurance is 
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executed without synchroni ?ation, and, when it is found that 
the data is not transferred correctly, it is re-started. 

FIG. 19 illustrates operation of the BLOCK system. The 
data dependence assurance system according to the BLOCK system 
5 uses a BLOCK instruction and a KKLKASE instruction provided 
by the MUSCAT. 

The parent thread first designates a store object memory 
address with the BLOCK instruction and then executes the FORK 
instruction to perform memory store. Thereafter, the parent 

10 thread executes the RELEASE instruction to indicate that data 
is prepared at the memory address. If the child thread tries 
to execute load from the address blocked by the parent thread, 
then the LOAD instruction is not completed until the parent 
thread executes the RELEASE instruction. Iu this manner, a 

15 value having been written into the memory by the parent thread 
(a value stored in the memory) can be read out (loaded from 
the memory) correctly by the child thread. The DSP system which 
is the other data dependence assurance system is one of 
speculation execution systems and is hereinafter described in 

20 detail. 

Now, a speculation execution function of a MUSCAT 
architecture is described with reference to FIGS. 20(A) and 
20(B) . The SPFORK instruction of the MUSCAT is a kind of FORK 
instruction and- indicates creation of a thread of a control 
25 speculation mode. A child thread created using the SPFORK 
instruction is executed in a state wherein the execution thereof 
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can be cancelled any time. In other words, although change 
of register values is permitted, accessing to an external memory 
is deferred. 

If the parent thread executes a THFIX instruction (thread 
settlement instruction) as seen in FIG. 20(A) , then the control 
speculation mode of the child thread is cleared, and memory 
changing operations accumulated in the insi de nf the chi I d thread 
are actually reflected on its memory. 

However, if the parent thread execute a THABORT 
instruction (thread abandon instruction) as seen in FIG. 20(B) , 
then the child thread is abandoned, and all changes which have 
been tried to perform for the register set or the memory are 
abandoned. It is to be noted that, if the parent thread is 
ended by the TEEM instruction before the parent thread executes 
the THFIX instruction or the THABORT instruction, then the 
control speculation mode of the child instruction is cleared. 

A thread of the control speculation mode is used in such 
a case that, although there is the high possibility that it 
maybe executed eventua 1 1 y , it cannot be determined at the earlier 
stage of the execution whether or not it should be executed. 
In other words, a control speculation mode thread is created 
anduscd for parallel processing at an early stage in the program, 
and it is discriminated whether or not processing by a thread 
generated later shouldbe performed actually to settle or abaudun 
the thread. 

The control speculation mode fork described above 
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predicts a flow of control and creates a thread speculatively . 
However, a function of predicting data dependence and executing 
a thread speculatively is prepared by the MUSCAT independently 
of the control speculation mode form. Such a thread state as 
5 just described is called H data- dependent speculation mode". 

Where the data -dependent speculation mode is used, the 
parent thread need not use the BLOCK instruction or the RELEASE 
instruction. The hardware architecture inspects memory data 
dependence between the parent and the child (the order in time 

10 between the store of the parent thread into the memory and the 
load of the child thread from the memory) upon execution, and 
if the child thread loads a wrong value, then the hardware 
architecture causes the child thread to execute the load again. 
The DSP met hod which is the other data dependence assurance 

15 system than the BLOCK system described above utilizes the 
data* dependent speculation mode. 

Referring to FIG. 21 , the parent thread performs the fork 
after it executes a DSPIN instruction which signifies to fork 
in the data- dependent speculation mode. A child thread 

20 generated by this starts execution in the data- dependent 
speculation mode . Then , if the parent thread executes a DSPOUT 
instruction, then the child thread returns the 
uon-data-dependent speculation mode from the data-dependent 
speculation mode. 

25 The data- dependent speculation mode does not require the 

BLOCK/RELEASE instructions and is advantageous in that the fork 
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can be performed even if a memory address which causes data 
dependence is not known in advance. However, it has a drawback 
in that, if data dependence occurs after the fork, then the 
child thread re-etarts its execution of a portion which is based 
on wrong data. 

Accordingly, an appropriate one of the BLOCK system and 
the DSP system should be selected depending upon the situation 
of data dependence involved in the program. 

Through the use of the FORK instruction and the control 
parallel supporting instructions of the data dependence 
assurance system and so forth, the MUSCAT architecture can 
extract a comparatively great number of parallelly executable 
portions from a program and thereby improve the execution 
performance of the program. 

A program for such a MUSCAT architecture as described 
above must be coded using the instructions described above f or 
each spot for which the fork is performed. Therefore, a compiler 
which automatically produces a machine instruction sequence 
from a high level language (high level programming language) 
is demanded more strongly than a conventional type of 
architecture. 

A compiler technique for a MUSCAT architecture is 
disclosed in Sakai et al. , "Automatic Pa ral leM zvng Method for 
Control-parallel Mult i- threaded Architecture n , IPSJ 
TRANSACTION, Vol. 40, No. 5, May, 1999, which is hereinafter 
referred to as Document 4 . An outline of the technique disclosed 



ia Document 4 is described below. 

Document 4 discloses a mechanism of a translator for 
converliiiK a machine instruction sequence produced by an 
ordinary sequential compiler into an instruction sequence for 
the MUSCAT. A control flow analysis and a data flow analysis 
are performed for a given machine instruction sequence, and 
parallelization is attempted using the FORK instruction tor 
each basic block. Here, the "basic block" is a aeries of 
ius true Lions which does not include intermediate branch or 
confluence of control . 

Parallelization for each basic block begins with 
replacement of a branching instruction positioned at the tail 
end uf the basic block with the control speculation mode KORK 
instruction (SPFORK instruction). This signifies to try to 
eAecule one of a plurality of basic blocks succeeding a certain 
basic block in parallel to the certain basic block. As regards 
which one of succeeding basic blocks shouldbe sel ected , Document 
4 recites that, where a loop structure is employed, that the 
basic block that is followed by a loop back edge (the returning 
direction of the loop) should be selected. Document 4 further 
discloses to use profile information to select one of the 
succeeding basic blocks which exhibits a high branch 
probability. 

Thereaft er , data dependence by accessing to a register 
and a memory between the basic block and a fork destination 
basic block and basic blocks succeeding the fork destination 
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basic block is investigated. 

Then, the instructions in the basic block are reordered 
so that the FORK instruction may be positioned on the upstream 
side as far as possible in the basic block. Such reordering 
5 of the instructions is performed taking the data dependence 
relationship into consideration, and if true dependence exists 
Lhrough a register, then the instruction is arranged on the 
upstream side with respect to the PORK instruction. Meanwhile , 
if positive dependence exists through a memory, then the HSWin 

10 instruction or the BLOCK instruction whose argument is a 
dependent memory address is inserted to the position immedi ate! y 
prior to the FORK instruction. 

As regards selective use of the DSPIN instruct inn anri 
the BLOCK instruction, Document 4 recites that , when the memory 

15 address which causes dependence cannot he determined ti I I 
immediately before the store and when, even if the memory address 
which causes dependence is determined successfully, the number 
of memory addresses that cause dependence is greater than a 
certain number, the DSPIN instruction should be used, hut in 

20 any other ca6C, the BLOCK instruction should be used. It is 
to be noted that, although Document 4 further discloses an 
instruction production procedure unique to the MUSCAT, since 
the direct relevancy of this to the subject matter of the present 
invention is poor, the instruction production procedure is not 

25 described herein. 

The prior art described above has the following problems . 
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First, there is room for augmentation in the criteria 
for selection of the fork destination. 

According to the prior art described above, statically 
a loop structure is grasped and dynamically profile information 
5 of an execution history is obtained, and the fork destination 
is determined based on the loop structure and the profile 
information. However, they merely fork a portion which is 
executed in a comparatively high probability on a flow of control , 
but no dala dependence is taien into consideration . Therefore, 

10 even if it is tried to execute a portion at which excessive 
data dependence is present by multi -threads, the parallel 
execution portion becomes short or waiting occurs at the 
data-dependent spot . As a result , there i s a problem that only 
a little improvement in performance can be achieved. 

15 The second problem resides in that the data dependence 

dealing procedure is different between the register and the 
memory , 

According to the procedure disclosed in Document 4 and 
so forth, reordering of instructions and processing of a new 
20 insertion instruction arc different between dependence through 
a register and dependence through a memory. However, in the 
inside of a compiler , an expression which uses a virtual variable 
called "intermediate term" is common ly used, and it is difficult 
to perform parallclization processing based on a discrimination 
25 between a register and a memory at this stage. 

On the other hand, even in a general compiler, as the 
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last stage is approached, register allocation is completed and 
distinction between a register and a memory is settled . However , 
if it is tried to perform parallelization in this stage, then 
it is difficult to perform processing of changing the program 
5 structure so that a bad influence may not be had on a control 
flow or a data flow optimized already. 



SUMMARY OF THE INVENTION 
I I is an object of the present invention to provide a 
10 program conversion apparatus and method and a recording medium 
suitable for a will Li- thread microprocessor by which it is made 
possible to perform parallelization processing based on a 
precise judgment at an intermediate term level in the inside 
of a compiler. 

15 It is another object of the present invention to provide 

a program conversion apparatus and method and a recording medium 
by which au object code which can extract a higher para I lei 
performance upon parallel execution can be generated. 

In order to attain the objects described above, according 

20 to an aspect of the present invention, there is provided a program 
conversion apparatus for converting a given source program into 
a program for a multi-thread processor including a plurality 
of program counters andaplurality of thread execution apparatus , 
comprising a register allocation trial section for trying 

25 register allocation prior to parallelization to estimate a 
register allocation situation of variables and intermediate 
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terms of an intermediate program, a fork spot determination 
section for determining based on a result of the register 
allucatiun trial by the register allocation trial section 
whether or not a conditional branch portion of the intermediate 
5 program should be converted into a parallel code for which a 
thread creation instruction ia used and determining a 
parallelization execution method with the parallel code, an 
instruction reordering section for converting the conditional 
branch portion in the intermediate program into a parallel code 

10 for which the thread creation instruction is used based on a 
result of the determination by the fork spot determination 
section and referring to the result of the register allocation 
trial to insert an instruction for assuring a data-dependence 
relationship between threads through a memory into positions 

15 before and after the thread creation instruction and reorder 
the instructions before and after the thread creation 
instruction so that thread creation may be performed in an early 
stage , and a register allocation section for performing definite 
register allocation so that , regarding whether or not a physical 

20 register is allocated to the parallelized and reordered 
instruction sequence, the same allocation result as that upon 
the register allocation trial may be obtained. 

According to another aspect of the present invention, 
there is provided a program conversion apparatus, comprising 

25 a syntax analysis section for Analyzing the syntax of a source 
program to produce an intermediate program, a paralleliaatiuu 
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section for performing optimization processing including 
parallelization for the intermediate program, and a code 
generation section for producing a target program including 
an instruction code for a target processor apparatus from the 
5 intermediate program optimized by the parallelization section, 
the parallelization section including an intermediate program 
inputting section for reading in the intermediate program and 
analyzing a control flow and a data flow, a register allocation 
section for trying to perform register allocation prior to 

10 parallelization to estimate a register allocation situation 
of variables and intermediate terms of the intermediate program 
and executing allocation of registers, aforkspot determination 
section for determining, based on a result of the trial of the 
register allocation, a spot of a conditional branch portion 

15 of the intermediate program to be converted into a parallel 
code for which a thread creation instruction is used, an 
ins traction reordering section for performing reordering of 
instructions before and after the parallelization spot from 
information of the parallelization spot determined by the fork 

20 spot determination section, the data flow and so forth, and 
an intermediate program outputting section for outputting the 
instruction sequence for which the conversion including the 
parallelization has been completed in a format of the 
intermediate program again. 

25 Preferably, the target processor apparatus is a 

multi-thread processor which includes a plurality of program 
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counters and a plurality of thread execution apparatus , the 
plurality of thread execution apparatus being operable to fetch, 
decode and execute a plurality of instructions of threads 
simultaneously in accordance with the plurality of program 
5 counters such that it is possible to execute, after a thread 
is created, the thread in a control speculative mode wherein 
a change having had an effect on a register set can be canceled 
later and to execute the thread in a data-dependence speculative 
mode wherein, when, after a self thread loads a value from a 
^ 10 memory location, a parent thread by which the self thread has 

C 5 been created stores a value into the same memory location, at 

ry least a processing result of the self thread after the load 

jp * is abandoned and the processing is re -executed, the multi- thread 

jg processorhavingan instruction set with which it can be executed 

J~ 15 by a single machine instruction or a combination of several 

IrH machine instructions for a thread being executed by any of the 

*S thread execution apparatus to create a new thread of the control 

H speculative mode, to end, if a designated condition is satisfied, 

the self thread and clear the control speculative mode of a 
20 thread of the control speculative mode createdby the self thread, 
to abandon the created thread of the control speculative mode, 
to give, when a thread created by the self thread performs load 
from a memory location of a designated address, an instruction 
in advance to temporarily block the operation, to clear the 
25 load temporary blocking instruction to the designated memory 
address, for the thread being executed by the thread execution 
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apparatus to create a new thread of the data -dependent 
speculative mode and to clear the data- dependent speculative 
mode of the thread of the data -dependent speculative mode created 
by the self thread. 
5 According to a further aspect of the present invention, 

there is provided a program conversion method for performing 
an optimization process including parallelization for an 
intermediate program outputted as a result of a synta* analysis 
on a program conversion apparatus whi ch compiles a source program 

10 and outputs a target program for a target processing apparatus 
of the raulti -thread type, compri sing a register allocation trial 
step of trying register allocation prior to parallelization 
to estimate a register allocation situation of variables and 
intermediate terms of the intermediate program, a fork spot 

15 determination step of determining based on a result of the 
register allocation trial whether or not a conditional branch 
portion of the intermediate program should be converted into 
a parallel code for which a thread creation instruction is used 
or performing determination of whether or not the conditional 

20 branch portion should be converted into a parallel code and, 
when such conversion should he performed, determination of a 
parallelization execution method, an instruction reordering 
step of converting the conditional branch portion in the 
intermediate program into a parallel code for which the thread 

25 creation instruction is used based on a result of the 
determination by the fork spot determination step and referring 
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to the result of the register allocation trial to insert an 
instruction for assuring a data -dependence rclationshipbetween 
threads through a memory into positions before and after the 
thread creation instruction and reorder the instructions before 
5 and after the thread creation instruction so that thread rreati on 
may be performed in an early stage, and a register allocation 
step of performing definite register allocation so that the 
same allocation result as that upon the register allocation 
trial may be obtained for the parallelized and reordered 
^_ 10 instruction sequence . 

°S With the program conversion apparatus and method, the 

ty following advantages can be anticipated. 

jp First, parallelization which uses the FORK instruction 

P on the intermediate program level con be performed precisely. 

L 15 The reason is that, although the register allocation 

section is positioned in a stage later than parallelization, 
'0 since reKiater allocation is tried by the parallelization 

'■=7 

M process, it can be estimated whether each intermediate term 

is to be placed into a register or stored into a memory location . 
20 Second, the performance when the FORK instruction is used 

to execute parallelization is improved. 

It is one reason that the fork spot determination section 
statically investigates the situation of data dependence 
between parent and child threads and selects the fork destination 
25 so that the possibility of temporary blocking of execution of 
the child thread caused by data dependence may be lowered. It 
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is another reason that the fork spot determination section 
investigates a static data dependence occurrence situation 
baaed on file information and selects the fork destination so 
that the possibility of temporary blocking of execution of the 
5 child thread or re-execution of the chi Id thread caused by data 
dependence may be lowered. 

The above and other objects, features and advantages of 
the present invention will become apparent from the following 
description and the appended claims, taken in conjunction with 
10 the accompanying drawings in which like parts or elements are 
denoted by like reference symbols. 

BRIEF DESCRIPTION OK THK DRAWINGS 
FIG. 1 is a flow diagram showing a general construction 
15 of a program conversion apparatus according to a first embodiment 
of the present invention; 

FIG, 2 is a flow diagram showing an internal construction 
of the program conversion apparatus; 

FIG. 3 is a flow chart illustrating operation of a fork 
20 spot determination section in the first embodiment ; . 

FIG. 4 is a flow chart illustrating different operation 
of the fork spot determination section in the first embodiment ; 

FIG. 5 is a flow chart illustrating operation of an 
instruction reordering section in the first embodiment; 
25 FIGS. 6(A) to 6(E) are flow charts illustrating a manner 

in which instructions arc reordered in the first embodiment; 
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FIG. 7 is a table illustrating control parallel 
correlation instructions in an intermediate program in the first 
embodiment ; 

FIG. 8 is a view illustrating an intermediate program 
5 before parallelization in the first embodiment; 

FIGS. 9 and 10 are similar views but illustrating the 
intermediate program during reordering of instructions in the 
first embodiment; 

FIG. 11 is a similar view but illustrating the intermediate 
^ 10 program upon ending of reordering of instructions in the first 

'O embodiment ; 

py FIG. 12 is a similar view but illustratingthe intermediate 

jr program upon ending of register allocation in the first 

U embodiment ; 

L 15 FIG. 13 is a flow chart illustrating operation of a fork 

■jf spot determination eoction in a second embodiment of the present 

*0 invention; 

M* FIG. 14 is a flow chart illustrating operation of an 

instruction reordering section in the second embodiment; 
20 FIG. 15 is a view illustrating an intermediate program 

before parallelization in the second embodiment; 

FIGS. 16(A) and 16(B) are tables illustrating profile 
information in the second embodiment; 

FIG. 17 is* a view illustrating the intermediate program 
25 upon ending of reordering of instructions in the second 
embodiment ; 



s s 
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FIG, 18 is a diagrammatic view illustrating a FORK 
instruction of a known MUSCAT architecture; 

FIG. 19 is a similar view but illustrating a BLOCK system 
of the known MUSCAT architecture; 

FIGS. 20(A) and 20(B) are similar views but i Llustrating 
a control speculation mode of the known MUSCAT architecture; 
and 

FIG. 21isas imi lar vi cw but i 1 lust rat ing a dat a - dependent 
speculation mode of the known MUSCAT architecture. 



10 



!tj Embodiment 1 



DES CRIPTION OF THE PREFERRED EMBODIMENTS 



Referring to FIG. 1, there is shown an example of 
configuration of a program conversion apparatus or compiler 
15 Lu which the present invention is applied. The program 
conversion apparatus 2 reads in a source program 1, performs 
a compiling process including para I lelization for the source 
program 1 and outputs a target program 3 obtained by the compiling 
process . 

20 A target program execution apparatus 4 receives the target 

program 3 and executes instructions of a target architecture. 
Further, the target program execution apparatus 4 collects 
execution information of the target program 3 and outputs a 
profile information file 5. 

25 The program conversion apparatus % includes a syntax 

analysis apparatus 10 for decoding and analyzing the syntax 
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of the source program 1 inputted thereto to produce an 
intermediate program, a parallelization apparatus 11 for 
performing an optimization process including parallelization 
for the intermediate program received from the syntax analysis 
5 apparatus 10, and a code generation apparatus 12 for producing 
an instruction sequence for a target architecture from the 
optimized intermediate program received from the 
parallelization apparatus 11. 

The parallelization apparatus 11 can receive the profile 
10 information file 5 as auxiliary information to perform 
optimization processing of a higher level. 

The syntax analysis apparatus 10 may have a known 
configuration and may naturally be composed of, for example, 
a lexical analysis section, a syntax analysis (purging) section 
15 and a semantic analysis section. Also the code generation 
apparatus 12 for producing an instruction sequeuce fur a target 
architecture from an optimized intermediate program may have 
a known configuration. 

FIG. 2 shows a configuration of the parallelization 
20 apparatus 11 of the program conversion apparatus 2, The 
parallelization apparatus 11 which is an essential component 
of the program conversion apparatus 2 according to the present 
invention is described in detail below with reference to PIGS. 
1 and 2. 

25 Theparallelizati on apparatus 11 receives an intermediate 

program 6 produced by the syntax analysis apparatus 10 , performs 
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an optimization process including parallelization for the 
intermediate program 6 and delivers another intermediate 
program 7 to the code generation apparatus 12 in the following 
stage. 

The parallelizati on apparatus 11 includes an intermediate 
program inputting section 20 for reading in the intermediate 
program 6 inputted to the parallelization apparatus 11 and 
analyzing a control flow and a data flow of the intermediate 
program 6 , a fork spot determination section 21 for determining, 
based on the control flow, data flow and profile information, 
a spot of the intermediate program 6 to be parallelized, a 
register allocation section 22 for trying register allocation 
to an intermediate term on the intermediate program 6 or executing 
such register allocation, an instruction reordering section 
23 for performing reordering of instructions before and after 
the parallelization spot from the determined parallelization 
spot and the information of the data flow and so forth, an 
intermediate program outputting section 24 for output ting the 
instruction sequence for which the conversion including the 
parallelization has been completed in a format of the 
intermediate program again, and a prof ile information inputting 
section 25 for receiving the profile information file 5 obtained 
by execution of a target program once and converting the profile 
information file 5 into a file of an internal format. 

Now , parallel i 7at ion operation of the program conversion 
apparatus 2 according to the embodiment of the present invention 
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is described in detail with reference to flow charts of FIGS. 
3, 4 and 5. 

In the embodiment of the present invention, the following 
instructions relating to control parallelizatiou can be 
described on an intermediate program. 

(1) Control speculation PORK instruction: 

The control speculation FORK instruction is used to create 
a child thread of the control speculation mode which starts 
execution from an instruction designated by the operand while 
the self thread continues execution of succeeding instructions . 

(2) Thread end instruction: 

The thread end instruction is used to end the self thread 
and place the child thread into the settlement mode. 

(3) Child thread abandon instruction: 

The child thread abandon instruction is used to abandon 
the child thread of the control speculation mode. 

(4) BLOCK setting instruction: 

The BLOCK setting instruction is used to instruct the 
processor to set a block to a memory address designated by the 
operand and temporarily stop (block) execution of the child 
thread when the child thread tries to execute load from the 
memory address. 

(5) BLOCK clear instruction: 

The BLOCK 'clear instruction is used to instruct the 
processor to clear the block set to the memory address designated 
by the operand and resume execution of the child thread 
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temporarily stopped (blocked) in the load from the memory 
address . 

(6) Register allocation indication instruction: 
The register allocation indication instruction is used 
5 Lu instruct the register allocation section to allocate a 
physical register to an intermediate term or a variable 
designated by the operand or conversely to allocate an area 
of the memory to an intermediate term or a variable designated 
by the operand. 

10 FIG, 3 illustrates an outline of operation of the fork 

spot determination section 21 in the program conversion 
apparatus 2 of the embodiment of the present invention. The 
fork spot determination section 21 performs the operation 
illustrated in FIG. 3 in a unit of a function in a given 

15 intermediate program, in particular, register allocation is 
tried in the function in step 2G, and then a fork spot 
determination process is performed for each conditional 
branching instruction included in the function in step 26. 

In the stage of step 26, various optimization processes 

20 including parallelisation are not completed as yet, and a 
definite register allocation process should not be performed 
as yet . Therefore , registration allocation is executed partly , 
and in a stage wherein information of to which intermediate 
terms /variables * in the intermediate program a register is 

25 allocated and which intermediate terms /variables are arranged 
on a memory is obtained, the register allocation process is 
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stopped without actually performing the allocation. 

Trial of the register allocation is performed by the 
register allocation section 22 (refer to FIG. 2) as hereinafter 
described. The register allocation section 22 include* a 
5 mechanism for ending its process in a stage wherein it is 
determined which registers are allocated to the individual 
intermediate terms /variables and returning only the register 
allocation situation without replacing the intermediate 
terms/ variables into the actual registers. 

10 FIG. 4 illustrates details of the process (step 26 uf 

FIG. 3) of the fork spot determination section 21 for each 
conditional branching instruction. 

Referring to FIG . 4, in step 31, the fork spot determination 
section 21 discriminates whether or not the conditional 

15 branching instruction corresponds to a return branch of a loop 
structure (repeat structure) in the inputted intermediate 
program. For the method of detecting a loop structure, refer 
to, for example, the description in A. V. Aho et al . , "Compilers 
II, Principles, Techniques, and Tools", translated into 

20 Japanese by Kcnichi Harada, SAIENSU-SHA, 1990, pp. 734-737, 
which is hereinafter referred tn as Document 5, 

If it is discriminated in step 31 that the conditional 
branching instruction corresponds to a loop return branch, then 
the direction of *the return branch , that is, the loop continuing 

25 direction, is determined as the fork destination and the 
conditional branch spot is selected as the for spot . The reason 
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is that, generally since a loop structure is inclined to be 
executed repetitively by a plural number of times , the processing 
a I the branching instruction corresponding to the loop return 
branch branches to the return branch spot with a high possibility . 
5 If the conditional branching instruction does not 

correspond to a return branch in step 31 , then the f ork spot 
determination section 21 calculates a minimum value of the 
distance of data dependence for each of the two branching 
destinations of the conditional branch in step 32. 
^ 10 Here,, the "distance of data dependence" is a 

representation by the number of steps in the intermediate program 

IB 

jtj of the position of the memory reference instruction from the 

j: Lop of a branching destination basic block for each of those 

P intermediate terms/variables estimated to be arranged on the 

]L 15 memory in step 26 from among the intermediate terms /variables 

Jjj which are defined in a basic block being the processing object 

C £ at present and may possibly be referred tn by the branching 

destination. 

In step 32, a minimum value of the distance of data 
20 dependence of the intermediate terms/variables is calculated 
for the two branching destinations. 

In next step 33, the two minimum values of the distance 
of data dependence determined regarding the opposite sides of 
the conditional branch in step 32 is compared with each other 
25 to discriminate whether or not they have a difference equal 
to or greater than a fixed value. 
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If the two minimum valiift.s have a difference equal to or 
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greater than the fixed value, then the branching direction of 
the branch which exhibits a hi gher minimum value of the distance 
of data dependence is determined as the fork destination and 
the conditional branch spot is selected as the fork spot . The 
reason is that the possibility that, where the branching 
direction selected here is forked as the new thread, the 
possibility that theprocesaingmay be stopped by data dependence 
immediately next to the fork is lower than that where the other 
is forked. 

When the distance of data dependence is determined in 
step 32, not the simple instruction step number but the cycle 
number (clock cycles or the 1 i tee J estimated to be required when 
the instructions arc executed on the processor of the target 
architecture. This makes more precise the selection in step 
33 described above that the branch with which data dependence 
occurs at a later timing is selected. 

In step 34, when the minimum valujes of the distance of 
data dependency do not have a difference equal to or greater 
than the fixed amount in the immediately preceding step, the 
branch which has been the branching destination in the original 
intermediate program (the taken side of the branching 
instruction (branch satisfaction side)) is determined as the 
for destination and the conditional branch sput is selected 
as a fork candidate. The selection of the for destination ie 
based on the same reason as that recited in the documents 



10 



20 0 11 3^290 16*323 IIARAOA PATENT FAX 0 3 (3560) 7056 ^0. 2628 P. 31 

- 27 - 

mentioned hereinabove as prior art documents. 

The fork spot determination section 21 determines the 
fork spot and the fork destination in such a manner as described 
above . 

In the embodiment of the present invention described above , 
the process of the fork spot determination section 21 described 
in detail above with reference to PIG. 4 makes it possible to 
refer to register allocation information to perform a 
parallelization process on an intermediate program without 
waiting a register allocatiun process which normally is 
performed in the last stage of optimization. 

In the embodiment of the present invention, since the 
processing in steps 35i and 33 of FIG. 4 is provided, the 
possibility of improvement of the performance at the other 
15 portions than the loop structure is raised. 

PIG. 5 illustrates operation of the instruction 
reordering section 23 of the paralleli2ation apparatus 11 of 
the program conversion apparatus 2 according to the embodiment 
of the present invention. FIGS. 6(A) to 6(E) supplementally 
20 illustrate an instruction reordering process of the instruct i on 
reordering section 23. In the following, operation of the 
instruction reordering section 23 is described with reference 
to FIGS , 5 and 6(A) to 6(E). 

Refcrring'first to PIG. 5, the instruction reordering 
25 section 23 performs a series of processes from step 40 to step 
\\ for each basic block which includes a fork spot determined 
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by the fork spot determination section 21. It is to be noted 
that the processes in steps 40 to 44 are all performed for an 
intermediate program. Instructions appearing in the 
description of the steps all denote corresponding instructions 
5 on the intermediate program. 

FIG. 6(A) schematically shows a structure of a basic block 
which is an object of processing of the instruction reordering 
section 23. "M:-. in FIG. 6(A) signifies an instruction to 
store into the memory. 

10 First in step 40 of FIG. 5, the instruction reordering 

section 23 investigates whether each of the intermediate terras 
and variables in the intermediate program is coordinated with 
a register or amemnry . This is discriminated by trying register 
allocation partly similarly as in step 32 of FIG. 4, In the 

15 processes from step 32 up to step 40, only a fork destination 
is determined , but the intermediate program i tself is not Changed 
and the register allocation situation has no difference. 
Therefore, a result of the register allocation trial in step 
32 should be saved And then the information should be referred 

20 to in step 40. 

In next step 41, the branching instruction at the tail 
end of the basic block which is the object of processing at 
present is replaced with (converted into) the control 
speculation mode FORK instruction. The operand of the control 

25 speculation FORK instruction, that is, the fork destination, 
is set to the fork destination selected by the fork spot 
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determination section 21. FIG. 6(B) shows a structure of the 
basic block when the processing up to Step 41 is completed. 

In- step 4V», a branching condition calculation statement 
(branching condition expression) positioned immediately prior 
5 to the control speculation FORK instruction in the intermediate 
program is moved to the position immediately next to the control 
speculation PORK instruction. Further, a sequence of 
instructions for "ending, when the branching condition is 
satisfied, the self thread and placing the child thread into 
10 a settlement mode which is a non-control speculation mode, but 
abandoning, when the branching condition is not satisfied, the 
child thread and keeping the self thread to continue execution 
of a succeedi ng i nstruct ion sequence " is inserted to the position 
immediately next to the destination of the movement, that is, 
15 to the tail end of the basic block. FIG. 6(C) shows a structure 
of the basic block when the processing up to step 42 is completed. 

In step 43, each of statements which are positioned 
forwardly of the FORK instruction, that is, on the upstream 
Side with respect to the FORK instruction in the basic block 
20 being the processing object at present and are to be substituted 
into the intermediate terms and variables coordinated with a 
memory in step 40 is moved Lo a position rearward I y of the FORK 
instruction, that is, on the downstream side with respect to 
the FORK instruction, and. the BLOCK setting instruction is 
25 inserted immediately prior to the FORK instruction while the 
BLOCK clear instruction is inserted immediately next to the 
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movement destination of the substitute statement . The operand 
of each of the BLOCK setting instruction and the BLOCK clear 
instruction to he inserted here is the memory address 
-representative of a substitution destination intermediate 
term/variable of the moved substitution statement. 

Depending upon the format of the intermediate program, 
a particular memory address may not be settled as yet in this 
stage. In this instance, the BLOCK setting instruction and 
the BLOCK clear instruction should be represented using a form 
similar to that of the intermediate terms/variables in the 
intermediate program and then should be converted into an 
instruction sequence indicatiug an effective memory address 
when code generation from the intermediate program is performed 
later. 

In step 43, from among the statements to be substituted 
into the intermediate terms and the variables coordinated with 
a register in step 40, those statements to be substituted into 
those intermediate tenus/ variables which may possibly be 
referred to by the fork destination must not be moved to the 
position next to the PORK instruction. The reason is that, 
since the value of the register is inherited by the child thread 
at the point of time of the fork, the register value defined 
by the parent thread after the fork is not delivered to the 
child thread. 

Since al I statements cannot necessarily be moved to the 
position next to the FORK instruction in this manner, when a 
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statement to be substituted into the memory is to be moved after 
the fork in step 43, the data dependence relationship between 
the statement to be moved and instructions succeeding the 
statement must be investigated and the statement must be moved 
only when an operation result same as that before the movement 
is obtained even if the execution order is changed by the 
movement . 

It is to be noted that the data dependence relationship 
necessary in this instance may be a common one to the compiler 
technique, and in the embodiment of the present invention, it 
can be obtained hy investigation based on the control flow and 
data flow analysis results produced by the intermediate program 
inputting section 20 shown in FIG. 2. 

FIG. 6(D) shows a structure of the intermediate block 
when the processing up to step 43 is completed. 

In step 44 of FIG. 5, the information assumed with regard 
to the register a I location of the intermediate terms and the 
variables in the preceding steps is inserted to the r.np of the 
basic block of the processing object at present. Since this 
information does not correspond to an actual machi ne i nstruction , 
it is described using the register allocation indication 
instruction which is a pseudo instruction on the intermediate 
program. 

PIG. 6(E) 'shows a structure of the basic bine* when the 
processing np to step 44 is completed. 

It is one of characteristics of the embodiment of the 
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present invention that the steps 40 and 44 arc provided. In 
particular, the program conversion method includes the step 
40 in which a register allocation situation is investigated 
prior to the fork conversion process in step 41 and the step 
5 44 in which the register allocation situation assumed by the 
fork conversion process in step 41 is indicated to the regi ster 
allocation section Tl. 

Therefore, detailed instruction reordering can he 
performed also for an intermediate program which uses 
10 intermediate terms and variable representations in the 
intermediate source program. 

It is to be noted that the processes in steps 41 to 43 
are similar to those described on pages 2 , 049 to 2 , 050 of Document 
4 mentioned hereinabove. 
15 Referring hack to FIG. 2, the register allocation section 

22 performs a register allocation process of coordinating areas 
allocated on the physical registers or the memory of the target 
architecture with the intermediate terms in the intermediate 
program . 

20 As a basic method for register allocation, a method of 

allocating the areas to the intermediate terms in the descending 
order in frequency of use of the intermediate terms , an a I location 
method by coloring of an interference graph or a like method 
canbeuscd. For'such allocation methods , referto, foreyample, 
25 the description on pages 659 to 665 of Document 5 mentioned 
hereinabove . 
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The register allocation process by the register 
allocation section 22 is different from the register allocation 
process by an ordinary compiler in that it operates in accordance 
with the register allocation indication instruction inserted 
in step 44 of FIG. 5. Where, tor example, a method of allocating 
registers in the descending order in frequency of use of the 
intermediate terms is adopted as the register allocation method, 
the frequency of each intermediate term designated so as to 
be placed into a regi ster by the register allocation indication 
instruction is set higher than those of the -other intermediate 
terms to raise the possibi Mty that the designated intermediate 
terms are allocated to the physical registers. 

On the other hand, where a method according to coloring 
is adopted as the register allocation method, when several 
intermediate terms to be allocated to the memory arc to be 
selected from among the intermediate terms corresponding to 
nodes each having a number of neighboring nodes exceeding the 
total number of physical resisters which can be allocated in 
the interference graph, those intermediate terms which are not 
designated so as to be placed into a register by the register 
allocation indicat i on i nstruction inserted in step 44 of PIC . 5 
are selected preferentially so as to raise the possibility that 
the intermediate terms designated so as to be allocated to a 
register may be - allocated to the physical registers . 

If the register allocation section 22 cannot allocate 
the physical registers to all intermediate terras designated 
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so as to be placed into a register by the register allocation 
indication instruction, then such intermediate terms are 
allocated to a memory location. The reason is that, since the 
program is converted by the instructiun reordering section 23 
5 so that the value of an intermediate term presupposed to be 
allocated to a register may be settled forwardly of Con the 
upstream side with respect to) the FORK instruction, even if 
such intermediate terms are allocated on a memory, an execution 
result of the program does not vary. 

10 On the contrary, the register allocation section 22 

performs a register allocation process so that those 
intermediate terms which are not desitfnated so as to be placed 
into a register hy the register allocation indication 
instruction may not be allocated to a register. For this 

15 processing, a process similar to that for a variable whose address 
i s referred to or a variable which cannot be arranged on a register 
such as a volat i 1 e variable in a conventional register allocation 
process can be applied. 
Working Examples 

20 The operation of the embodiment uf the present invention 

described above is described in more detail in connection with 

particular working examples. 

Working Example l 

FIG. 8 illustrates an example uf an intermediate program 
25 to be parallelized by the paralleli2ation apparatus 11 of the 

program conversion apparatus 2 uf the embodiment of the present 
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invention. Referring to KIG. 8, reference characters tl to 
t28 denote intermediate terms, and I, J, K. R and X denote 
variables declared in the source program. 

,f signifies that the value of the right side is stored 
iutu the place indicated by the left side. 

"4 n is a prefix operator which returns a memory address 
into which a variable is placed, 

"mem(a)" indicates contents of the memory whose address 
is given by the value of* a, and if this is on the right side 
to = then this signifies memory load, but if this is on 
the left side, then this signifies memory store. 
LI, L2 and L3 are labels. 

The numerals (l ) to (37) in parentheses indicated at the 
left end (column) of FIG. 8 are numbers applied for the 
15 convenience of description, and (Bl) to (B3) at the right end 
represent basic block numbers. 

FIG. 7 shows a table of instructions relating to control 
parallel on an intermediate program to be used for operation 
of the present working example. 
20 SPFORK 1 is used to create a speculation (control) mode 

child thread for starting execution from the operand 1. 

TTERM c is used to end the self thread and settle the 
child thread if the operand c is true. 

FTERM is used to end the self thread and settle the child 
25 thread if the operand c is false. 

THABORT is used to abandon the child thread of the 
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speculation mode. 

BLOCK m is used to designate a memory address designated 
with the operand m for block. 

RELEASE m is used to clear the block set to a memory address 
designated with the operand m. 

DSPIN is used to create a child thread created by a 
succeeding fork in the data-dependent speculation mode. 

DSPOUT is used to clear the data-dependent speculation 
mode of the child thread. 

RDCL tl , ... is used to instruct to allocate intermediate 
terms /variables designated with the operand tl , ... to a register. 

MDCL tl, ... is used to instruct to allocate intermediate 
terms/variables designated with the operand tl, ... to d memory. 

Referring to FIG, 2, the fork spot determination section 
21 receives the intermediate program illustrated in FIG. 8 and 
determines a fork spot. 

It is assumed that register allocation is attempted in 
step 25 of FIG. 3 and a trial result is obtained that a physical 
register is allocated to all intermediate terms tl to t28 and 
the variables I, K and R while an area of a memory is allocated 
to the variables j and X. 

In step 26 of FIG. 3, the basic block Bl including a 
conditional branching instruction is determined as an object 
of parallclization conversion. In the following, operation 
of a fork spot determination section 21 is described with 
reference to FIG. 4. 
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A look structure check is performed in step 31 . However, 
since the conditional branch of (11) of FIG. 8 is not a loop 
return branch, the processing advances to step 

In step 32, the distance of data dependence is determined 
3 between the basic blocks Bl and B2 and between the basi c bl ocks 
Bl and B3 of FIG. 8. 

First, data dependence between the basic blocks Bl and 
B2 is examined. Here, data dependence is found between the 
memory store at (7) of the basic block and the memory load at 
10 (14), (18) and (19) of the basic block B2. 

The memory accesses here actually are the store into the 
array element X[I] and the load from the variable J and the 
array element XTJ1 , and if the memory locations for the array 
X and the variable J do not overlap with each other and the 
15 values of I and J are different from each other, then no data 
dependence occurs. In particular, in the block Dl, tl:=&X in 
(11) places the top address of the array X into the intermediate 
term tl, and since one array element is composed of 4 bytes 
(t4=t2*t3) and t5=tl+t4, mem(tS) in (7) indicates the memory 
20 address for the array element X[I] and (7) represents the memory 
store of t6 into the memory address. Further, In the block 
B2, tl5:=mem(tl4) in (18) represents the memory load from the 
array element X[J] . 

Here, however, the description proceeds on the assumption 
25 that a result of the data dependence analysis indicates that 
a positive proof that such conditions are always satisfied is 
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nut obtained and it is discriminated that, potential memory data 
dependence is present between the memory store and the memory 



The distance of data dependence between the basic blocks 
Bl and B2 is 1, 5 and 6 as counted with the number of steps 
on the intermediate program of FIG. 8. Here, since the label 
LI in (12) Is a non- executable statement, it is not counted 
in the step number, and the step number is counted in such a 
maimer that the instruction in (13) is counted as 0, the 
instruction in (14) is counted as 1, and the instruction in 
(15) is counted as 2. Consequently, the minimum value of the 
distance of data dependence between the basic blocks Bl and 
B2 is 1. 

Similarly, between the basic blocks Bl and B3, data 
dependence is found between (7) of the basic block Bl and (29) 
and (33) of the basic block B3, and the distance of data dependence 
is5and9, respectively. Thus, the minimum va hie of the distance 
of data dependence between the basic blocks Bl and B3 is 5. 

In step 33, the minimum values fi and 10 of the distance 
of data dependence determined as above are compared with each 
other, and it is discriminated that the di ff erence between them 
is sufficiently largo. Consequently, the branching direction 
of the basic block B3 side which exhibits a hi gher minimum value 
of the distance- of data dependence is selected as the fork 
destination. 

If the prospect that the variable J is allocated not to 
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a memory but to a register is obtained in step 2b of Via. 3, 
then the minimum value of the distance of data dependence between 
the basic blocks Bl and 82 and between the basic blocks Hi and 
B3 is 5 and 9, respectively, and consequently , the basic block 
5 B2 side is selected as the fork destination in step 33. 

Now, operation of the instruction reordering section 23 
is described particularly with reference to Ki(i. 5. it is 
assumed that, in the present working example, the instructions 
relating to control parallel illustrated in FIG. 7 can be used 
10 on an intermediate program. 

If the intermediate program described as an example in 
the foregoing description is given to the instruction reordering 
section 23, then the instruction reordering section *2:i performs 
an instruction reordering process so as to perform the fork 
15 from the basic block Bl to the basic block K3. 

In step 40 of FIG. 5, the instruction reordering section 
23 acquires the information that the intermediate terms tl to 
t28 and the variables I, K and R are allocated to a register. 

In step 41 of FIG. 5, the instruction reordering section 
20 23 replaces the branching instruction in (11) of FIG. 8 (goto 
L2 next to then) with the SPFORK instruction which is a control 
speculation FORK instruction. The operand of the SFFORK 
instruction is the basic block B3 determined as the fork 
destination, that is, the labelL2 (SPFORK L2 in (58) of FIG. 9) . 
25 In step 42 Of FIG. 5, a series of instructions (8) to 

(10) which form a statement for calculation of the conditional 
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branch in FIG. 8 is moved to the position immediately next to 
the SPFORK instruction, aud the FTERM instruction (an 
instruction to end the self thread when the condition is not 
satisfied) which is a conditional thread ending instruction 
5 conforming to the hranching condition of (11) and the THADORT 
instruction as well as an unconditional branching instruction 
(goto LI) to the basic block Bl which is a succeeding block 
are inserted next to the moved series Of instructions (8) to 
(10). 

10 Thc instruction sequeuce mentioned is inserted so as to 

achieve the following operation. 

In particular, after the SPFORK, branch condition 
calculation is performed to discriminate whether or not the 
SPFORK is really correct. 
15 1^ the SPFOKK is correct (speculation success) , then the 

self thread (parent thread) it> ended and simultaneously the 
created child thread is changed in mode from the control 
speculation mode to the settlement mode (a non-control 
speculation mode) with the FTERM which is a kind of conditional 
20 thread ending instruction. 

On the other hand, if the SPFORK is not correct (speculation 
failure) , then the FTERM instruction does nothing, and the child 
thread is abandoned with the succeeding THABORT instruction, 
and thc self thread coutinues its execution of instructions 
25 of the branching destination opposite to the FORK destination 
with thc unconditional brauching instruction (goto u in (64) 
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of FIG. 9) . FIG. 9 il histrates the intermediate program which 
has been subject to the conversion up to step 42 of FIG. 5 from 
the intermediate program illustrated in PIG. 8. 

In step 43 of FIG. 5, a series of instructions (56) and 
(57) of FIG, 9 which form a memory store statement is moved 
to the position immediately next to the SPFORK instruction (58) 
((108) and (109) of FIG. 10), and the RELEASE instruction is 
inserted to the position immediately ne*t tu the moved series 
of instructions ((110) of FIG. 10). 

For the operand of the RELEASE instruction, the same 
intermediate term as the operand of the moved store instruction 
(57) ie used. Further, the BLOCK instruction whose operand 
is the same intermediate terra as the operand of the store 
instruction (57) is inserted to the position immediately 
preceding to the SPFORK instruction (58) . FIG. 10 illustrates 
the intermediate program which has subject to the conversion 
up to here. 

Here, the reason why, upon movement of the memory store 
statement after the FORK, not all of the instructions (51) to 
(57) but only the instructions (56) and (57) are moved is that 
it is intended to make it possible for an intermediate term 
having an effective memory address tu be re-utilized with the 
BLOCK instruction and the RELEASE instruction. If an 
optimization function called "euuimun subexpression 
elimination" in the field of the compiler is used, redundant 
effective address calculation is deleted by common 
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subexpression elimination optimization even if such program 
conversion as to re-calculate an effective address each lime 
the BLOCK instruction or the RELEASK instruction is executed 
is performed here. 
5 In step 44 of FIG. 5, the RDGL instruction and the MDCL 

instruction are inserted to the top of each of the basic blocks 
Bl , B2 and B3 . The instructions are for the regi ster allocation 
section 22 in the following stage, and the RDCL instruction 
is used to perform register allocation to a desi gnated variable 

10 or intermediate term whereas the MDCL instruction is used to 
perform allocation of a memory 1 ocati on to a designated variable 
or intermediate term. 

FIG. 11 illustrates the intermediate program which is 
subject to the conversion up to here. The instructions (201) 

15 to (203) , (221) to (223) and (235) to (2X7) have been inserted 
in step 44. 

Referring back again to KIG. after the instruction 
reordering, the register allocation section 22 allocates a 
physical register to each variable or intermediate term which 

20 is to be placed into a register. 

In the present embodiment, the architecture (target 
architecture) of an apparatus by which a target program output ted 
from the program conversion apparatus is executed has 32physical 
registers rO to r31, and such register allocation is performed 

25 that the physical registers rio to rl9 are used for register 
variables (those of variables in the source program which are 
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allocated to physical registers) and the physical registers 
r20 to r30 are used for working registers (registers principally 
for holding results during arithmetic operation). 

The register allocation section 22 allocates the physical 
5 registers rll, rl2 and rl3 to the variables I, K and tt, 
respectively, and allocates the physical registers r20 to r30 
in order to the intermediate terms tl to t28. 

FIG. 12 illustrates the intermediate program after the 
registers are allocated to the intermediate program i 1 lust rated 
10 in PIG. 11. It is to be noted that, although the intermediate 
program of FIG. 12 includes redundant instnmtions, 
]t{ redundancies of them can be eliminated by anoptimizationprocess 

1=2 proposed cunvexitionally . Various conventional optimization 

»E methods are recited , for example , on pages 772 to 790 of Document 

15 5 mentioned hereinabove, 
hj Since such optimization processes are preferably 

performed before register allocation, they are incorporated 
preferably forwardly of the fork spot determination section 
21 in FIG. 2, for example, in the inside of the intermediate 
20 program inputting section 20. 
Embodiment 2 

Now, a second embodiment of the present invention is 
described in detail. The second embodiment of the present 
invention is characterized in that profile information is 
25 referred to to select a data save dealing method of the fork 
destination and upon the fork. However, the second embodiment 
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of the present invention is basically same in the other points 
as the first embodiment described hereinabove. 

Referring toFIG, 1, in the second embodiment of the present, 
invention , the program conversion apparatus 2 is used to produce 
5 a target program 3 from a source program 1. At this time, the 
program conversion apparatus 2 embeds information for 
coordination between a machine instruction address and an 
intermediate program used in the program conversion apparatus 
2 into the target program 3. The target program execution 
10 apparatus 4 executes the target program 3, collects execution 

5 | 

yj information during the execution of the target program 8 and 

ry outputs the collected execution information as a profile 

! ^ information file 5. 

'fl Then, the program conversion apparatus 2 is used to 

15 parallelize the source program 1 to produce the target program 
y -3. At this time, the profile information file 5 is used to 

produce a target program 3 having ahigher executi on performance . 
'{2 The configuration of the program conversion apparatus 

2 is substantially similar to that in the first embodiment 
20 described hereinabove. However, the program conversion 
apparatus 2 is different in operation of the fork spot- 
determination section 21 and the instruction reordering section 
28 thereof from that in the first embodiment in that the fork 
spot determination section 21 and the instruction reordering 
25 section 23 refer to the profile information to perform a 
parallelization process with which a higher execution 
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performance can be anticipated. 

The operation of the fork spot determination section 21 
in the second embodiment of the present inventi on is generally 
same as that in the first embodiment described hereinabove with 
reference to FIG . 3 . In particular , the f ark spot determination 
section 21 tries, for each function in an intermediate program 
given thereto, register allocation in the function in step 26 
of FIG, 3 and then performs a fork spot determination process 
for each conditional branch instruction inducted in the function 
in step 27 

FIG. 13 illustrates the fork spot determination process 
(step 26 of FIG. 3) for a conditional branching instruction 
in the second embodiment . 

Referring to PIG. 13, in step 50, the fork spot 
determination section 21 discriminates whether or not the 
conditional branching instruction corresponds to a return 
branch of a loop structure in the inputted intermediate program. 
This process is same as that in step 31 (refer to FIG. 4) in 
the first embodiment described hereinabove. 

If the conditional branching instruction is a return 
branch of a loop structure, then the direction of the return 
branch is provisionally determined as the fork destination. 
This signifies that, if the fork is to be performed, then this 
direction should be determined as the fork destination, and 
it is determined in a later stage whether or not the fork is 
performed actually . 
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In step 51. the fork spot determination section 21 
calculates probabilities with which the taken (branching 
satisfaction) aide /fall -through side of the conditional 
branching instruction are selected based on the received file 
3 information. 

In step 52, the fork spot determination section 21 
discriminate** whether or not the two probabilities calculated 
in step 51 have a difference greater than a fixed value. 

If the difference between the branch probabilities 
10 exceeds the criterion, then the side which exhibits a higher 

O 

%B probability is provisionally determined as the fork 

!H 

in destination. 

l Z . In step 53, the minimum value of the distance of data 

! |: dependence is calculated for each of the two branching 

15 destinations uf Hie conditional branch. This process is the 

£—*: 

hi same as that in step 32 (refer to FIG. 4) in the first embodiment 

i w 

i|] described hereinabove. 

I[7 In step 54, the two minimum values of the distance of 

data dependence determined for the opposite sides of the 
20 conditional branch in step 53 are compared with each other to 
discriminate whether or not they have a difference equal to 
or greater than a fixed value. 

When they have a difference equal to or greater than the 
fixed value or -no data dependence is found, the branching 
25 direction uf the side which exhibits a higher minimum value 
of the distance of data dependence is determined ao the fork 
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destination in step 55. This Is a process similar to that, in 
step 33 (refer to FIG. 4) in the first embodiment described 
hereinabove . 

In steps 58 and 59, the fork spot determination section 
5 21 calculates the minimum value of the distance of data dependence 
in a similar manner as in step 53 with regard to the fork 
destination provisionally determined in step 56 or 57 and 
discriminates whether or not the minimum value of the distance 
of data dependence or the provisionally determine fork 
10 destination side is aquai zo or greater than a fixed vaiue . 

If the minimum value of the distance of data dependence 
of the provisionally determined fork destination side is equal 
to or greater than the fixed value or data dependence through 
a memory is not found, then the fork destination provisionally 
15 determined in step 56 or 57 is decided as the formal fork 
destination in step 60. 

If it is discriminated in step 54 or 59 that the minimum 
value of the distance of data dependence is lower than the fixed 
level, then the basic block is excepted from the fork spot in 
20 step 67. This is performed, for example, by applying a fork 
target exception mark to the conditional branching instruction 
so that the basic block may be excepted from an object of 
parallelization in later processing. 

After the conditional branching instruction is determined 
25 as the fork spot or one of the branching destinations or the 
branching instruction is determined as the fork destination 
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in steps 50 to 60, a data dependence nnnnrrftnce frequency is 
calculated in 3tcp 61. In particular, the fork spot 
determination section 21 calculates, based on th* profile 
information, a ratio of the number of tines by which a value 
5 defined in the basic block of the fork snnrce (the basic block 
which includes, at the tail end thereof, the branching 
instruction which is the processing nhjecr. at present ) is 
referred to by the basic block determined as the fork destination 
to the number of times by which this path vthe flow of control 

10 from the current basic biock to vhe basic block determined as 
the fork destination) is passed. 

In this data dependence occurrence frequency calculat ion . 
data dependence by those intermediate terms and variables which 
are finally allocated to a register ia excepted and only those 

15 intermediate terms and variables arranged on the memory are 
used as an object of calculation similarly as in step 32 of 
FIG. 4. 

In stop 62, it is discriminated whether or not the data 
dependence occurrence frequency is equal to or higher than a 
20 fixed level. If the data dependence occurrence frequency is 
higher, then the processing advances to step fin, hut otherwise, 
the processing advances to step 63. 

In Step 63. the fork spot determination .section vn counts 
the number of those intermediate terms/variables on the memory 
25 which may possibly cause data dependence from the for* source 
basic block to the forkdestinationbasicblock and discriminates 
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whether or not the count value is equal to or higher than a 
fixed level. This counting is performed statically by 
inspection of the instruction sequence in the intermediate 
program without depending upon the profile information. If 
the data dependence spot number is equal to or greater than 
the fixed level, then the fork spot determination section 21 
determines that the fork according to the DSP system should 
be used in step 64 , but otherwise, she fork spot determination 
section 21 determines that the fork according to the BLOCK system 
should be used in step 66, Then, the fork spot determination 
section 21 applies the information of the determination to tha 
FORK instruction in the intermediate program. 

In seep 65, the fork spot determination section 21 counts 
the number of those variables on a memory which exhibit data 
dependence similarly as in step 63 . If the count value is equal 
to or smaller than a fixed level, then it is determined in step 
66 that the fork according to the BLOCK system should be used, 
but if tho count value is greater than the fixed level, then 
the basic block is excepted from the fork candidate in step 
67. 

FIG. 14 illustrates operation of the instruction 
reordering section 23 in the second embodiment of the present 
invention. Referring to FIG. 14, the instruction reordering 
section 23 performs a scries of processes from step 70 to step 
78 based on a fork spot and a fork data assurance method der.ermi npn 
by the fork spot determination section 21. It is to be noted 



that the processes in steps 70 to 76 are all performed for an 
intermediate program. The instructions which appear in the 
description of the steps all denote corresponding instructions 
on the intermediate program. 

The processes in step 70, 71 and 72 are similar to those 
in steps 40, 41 and 42, respectively, of FIG. 5 described 
hereinabove in connection with the first embodiment. 

In step 73, the instruction reordering section 23 checks 
whether che fork data assurance system for the fork spot 
determined by the fork spot determination section 21 in the 
preceding stage is the BLOCK system or the i)SH system. It the 
fork data assurance system is the BLOCK system, then the 
processing advances to step 74, but if the fork data assuranr.fi 
system is the DSP system, then the processing advances to step 
75. 

The process in step 74 is similar to that in step 43 of 
FIG, 5 described hereinabove in connection with the first 
embodiment. In particular, a memory store statement before 
the fork is moved to the position next to the fork and necessary 
BLOCK setting and BLOCK clear instructions are inserted. 

Upon such movement, a data dependence relationship is 
inspected , and the statement must be moved only when an operation 
result same as that before the movement is obtained «ven if 
the execution order is changed by the movement, similarly as 
in step 43 of FIG. 5. 

Also the process in step 75 is similar to that in step 



43 of FIG. 5 in that a substitute statement into an intermediate 
terminal coordinated with a memory is moved to the position 
next to the FORK instruction. However, whereas, in step A3 
of FIG. 5, the BLOCK setting instruction and the BLOCK clear 
instruction whuae operand is the memory address of the accessing 
object are inserted in step 43 of FIG. 5, the process in step 
75 is different in that the FORK instruction produced in step 
71 is modified so that the fork may be performed in the 
data- dependent speculation mode. 

The process in step 76 is similar co that in 3tep 44 of 
FIG. 5 described hereinabove in connection with the first 
embodiment . 

In rhis manner, in the second embodiment, of the present 
invention, profile information is used to determine whether 
or not the fork should be performed and the data dependence 
assurance method upon the fork. Therefore, where the flow of 
control is biased to one of the branches at a conditional branch , 
the success probability of the control speculation fork is raised 
by forking the direction. 

Further, since parallclization is performed taking the 
frequency of actually occurring data dependence and the number 
of dependent spots into consideration, the overhead upon 
execution of a parallelization program i s decreased thereby 
to make it easierto extract the performance by parallelization . 
WurkiuK Example 2 

Now. operation of the second embodiment of the present 



- 52 - 



invention is desci'ibed in connect ion with a particular working 
example. PIG. 15 illustrates an example of an intermediate 
program to be parallelized by the parallelization apparatus 
of the present invention. Characters, symbols and so forth 
appearing in FIG. 15 have the same meanings as those used in 
the first working example and illustrated in FIG. 3. Also the 
instructions relating tu control parallel used on the 
intermediate program are same as those used in uhc first 
embodiment and xliuburaced in FIG. !\ 

Referring co FIG. I. in "he second working example of 
the present embodiment , the program conversion apparatus 2 
converts the source program 1 into the target program 3 without 
parallelizing the source program 1. Thereupon, the program 
conversion apparatus 2 inserts, to the top of each basic block, 
a label bavin* a name based on an identification number of the 
basic block and places symbol information regarding such labels 
into the tar*et program 3 so that the symbol information is 
outputted together with the target program 3. To embed symbol 
information into a target program is a very common practice 
in the field of the compiler, and any technique can be used 
only if a symbol name and an address coordinated with the symbol 
can be extracted from the target program . 

The target program execution apparatus 4 reads in the 
target program 3 and recognizes a set of basic blocks in the 
target program 3 based on symbol information embedded in the 
target program 3. Consequently, also the target program 



execution apparatus 4 can recognize the basic block set whose 
delimiting manner is equivalent to that of the basic block set 
which composes the intermediate program in the inside of the 
program conversion apparatus 2. 

The target program execution apparatus 4 decodes and 
executes machine instructions which compose the read in target 
proMraiu 3 while it collects information of behaviors of the 
target program i. particularly of: 

(1; the number uf simes by whicn she condition of each 
conditional branching instruction is satisfied and the number 
of times by which the condition is not satisfied; and 

(2) the number of time6 of memory data dependence between 
basic blocks which are adjacent each other on the control flow 
and pertaining machine instruction addresses. 

After execution of the target program 3 is completed, 
the target program execution apparatus 4 converts the machine 
instruction addresses from within the collected information 
into identification numbers of basicblocks and outputs a prof ile 
iuf urination file 5 which includes contents of: 

(1) the number of times by which the control flows from 
each basic block to a succeeding basic block on the control 
flow ; and 

(2) the number of times by which memory data dependence 
is caused between basic blocks which arc adjacent each other 
uu the control flow. 

FIGS. 16(A) and 16(B) illustrate part of profile 
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information included in the profile inf omrnti on ri i e 5 ontputted 
from the target program execution apparatus 4 when a target 
program corresponding to the intermediate program illustrated 
is FIG. 15 is given to the target program execution apparatus 

5 4. 

FIG. 16(A) illustrates the number of times of branching 
between basic blocks and indicates that the number of rimes 
of branching, for example, from the basic block Bll to the basic 
blocks B12 and B13 is 20 and 180, respectively 
10 FIG. 16(B) illustrates the number of <;imes of memory data 

dependence between basic blocks and indicates that the total 
number of times by which, for example, a value stored in the 
basic block B13 is loaded in the basic blor.k KlH is !WJ. 

Now, operation of parallelizing the source program 1 when 
15 the profile information file 5 is given to the program conversion 
apparatus 2 is described. 

Referring now to FIG- 2 ( the intermediate program 8 whi ch 
is quite same as that when the source program is converted for 
the first time is given to the parallel i zati on apparatus 11. 
20 The intermediate program inputting section 20 reads in 

the intermediate program 6 and performs a flow analysis and 
then delivers the intermediate program 6 to the fork spot 
determination section 21. 

On the other hand, the profile information inputting 
25 section 25 reads in the profile information rile 5 produced 
by the target program execution apparatus 4. Contents of the 
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prof ile information read in hy ttmprof iie information inputting 
section 25 when the example of intermediate program of FIG. 
15 is used are such as illustrated in MUS. 16(A) and 16(B). 

Referring to FIG. 2, the fork spot determination section 
5 21 receives the intermediate program illustrated in PIG. 15 
and performs determination of a fork spot. 

It is assumed that, in st*p 25 of FIG. 3, register 
allocation is tried and a physical register is allocated iu 
all of the intermediate terms r.l r.o C43 and the variables J 
10 and P while an area of the memory is allocated lo llie variables 
K, X. Y and Z. 

In step 26 of FIG. 3 ; the basic blocks Bll, BIS and B15 
each of which includes a conditional branch are determined as 
an object of parallelization conversion. 
15 In the following, operati on of the fork spot determination 

section 21 for the basic blocks Bll, B13 and BIG is described 
with reference to FIG. is. 

It is discriminated in step 50 that the basic block Bll 
is not a loop return branch. 
20 In step 51, branching probabilities are calculated from 

the profile information illustrated in FIG. 16(A), and it is 
determined that the probability of branching Lo Lhe basic block 
B12 is 10 % and the prohahi I ity of branching to the basic block 
B13 is 90 %. 

25 In step 52, using it as a criterion whether or not there 

isabiae of two times ormore inratio, theforkspot cielerwinai,ion 
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section 21 discriminates that the hi as in branching probability 
from the basic block Bll is sufficient and thus provisionally 
determines that the basic block B13 is the fork destination 
in step 57. 

In step 58. memory data dependence is investigated. 
However , since the basic block Bll does not include the memory 
store, the basic block B13 is determined as the fork destination 
in step 60. 

Tlieu in step 61 , a data dependence occurrence frequency 
is determined. However, since there is no memory data 
dependence regarding the basic block hii , after all the BLOCK 
system is decided as a candidate in step GG. 

The branch probability of the basic block B13 is 15 % 
to the basic block B13 and 85 % to the basic block B15, and 
bicepL this, the basic block B13 is subject to similar steps 
to those for the basic block Bll described above. After all, 
il is determined in step 60 that the hasic block B15 is the 
fork destination, and the BLOCK system is determined as a 
candidate in step 66. 

With regard to the basic block D15, the branching 
probability is 15 % to the basic block Blfi and 85 % to the basic 
block B17, and it is discriminated in step 52 that the bias 
in branching probability is snf f i ci ent . Thus , the basic block 
B17 is provisionally determined as the fork destination in alep 
57. 

The minimum value of the distance of data dependence from 
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the basic block BIS to the basic block B17 is 6, and if the 
criterion in step 59 is that the distance of data dependent 
is 4 or more, then the haste block B17 is determined aa the 
fork destination in step 60. 

If the data dependence occurrence frequency from the basic 

block B15 to the basic block D17 is determined in step 61 based 
un the profile informati on illustrated in FIGS. 16(A) and 16(B) , 

then it is 4/170 and hence approximately 2.4 %. 

If the criterion for the occurrence frequency in step 

62 is 30 %, then it is discriminated that uhe occurrence frequency 

above is low. 

In step 63, the number of memory accessing spots which 
may possibly cause data dependence is counted from within the 
intermediate program. 

The basic block K15 includes mem at the two spot3 on the 
left side and includes the variable K, which is allocated on 
a memory, at one spot on the left side. 

The memory stores listed all have Lhe possibility that 
overlapping of an address may occur with the memory load in 
the basic block B17, and therefore, totaling three memory 
data -dependent spots are found. 

If the criterion for the number of dependent memory spots 
in step 63 is 3 or more, then it is discriminated that the basic 
block B15 has a greater number uf dependent spots, and 
consequently, the USH system is determined as a candidate to 
the fork system in step 64. 
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Here, if it is assumed that the branching probability 
from the basic block B15 to the basic blocks 16 and 17 is 40 % 
ami 80 %, respectively, then it is discriminated in step 52 
that the bias in branching probability is small. 

IT the distance of data dependence is determined in step 
S63, then the minimum value of the distance of data dependence 
from the basic block B15 to the basic block B16 is 5 and also 
the minimum value of the distance of data dependence from the 
basic block Bio to the basic block B17 is 5. Consequently, 
it is discriminated in step. 54 chat the difference between the 
dependence distance is small 

Consequently, the basic block Bio is eACepted from a 
candidate to the fork spot, in step 67. 

Now, operation of the instruction reordering section 23 
in the second working example is described particularly with 
reference to FIG. 14. 

The instruction reorripring section 23 performs a series 
of processes illustrated in FIG. 14 for each of the conditional 
branches of the basic blocks Hi], B13 and B15. 

With regard to the basic blockDll, the SPFORK ins I ruction 
to Lhe basic block B13 is produced in step 71 , and an instruction 
group for conditional expression calculation is moved to the 
position next to the SFH'ukk instruction in step 72. 

For the data dependence assurance in the fork from the 
basic block Bll, the BLOCK system is determined as a candidate. 
However, since a memory access to be blocked is nut present, 
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the BLOCK instruction or the RELEASE instruction is not inserted 
in step 74 . 

In step 76, the RDCL instruction whose operand is the 
intermediate terms tl, t2 and t3 scheduled Lu be placed into 
the register is inserted. 

Also the basic block B13 is processed in a flow similar 
Lu that for the basic block kii described above since data 
dependence assurance of the BLOCK system is performed. 

As regards the basic oiock 315 ? since data dependence 
assurance is performed in accordance with che DSP system, 
movement of a memory store instruction group is performed and 
an instruction indicating the data -dependent speculation mode 
is inserted in step 75 of km;. 14. 

In particular, mem(tl2), mem(tl7) and a statement for 
store into the variable K are moved to the position next to 
the SPPORK instruction, and the DSPOUT instruction indicating 
to end the data-dependent speculation mode is inserted to the 
position immediately next to them. 

Further, the DSPTN instruction indicating to create a 
child thread in the data-dependent speculation mode is inserted 
to the position immediately prior to the SPFORK instruction. 

FIG. 17 illustrates the intermediate program after the 
processing of the instruct i on reordering section 23 in the second 
embodiment of the present invention is completed. 

It is to be noted that the embodiments described above 
may be carried out in combination with some other fork spot /fork 
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destination die termination method. For example, a method of 
utilizing a fork boost value representing by what number of 
ilia I ructions the FORK instruction can be moved to the upstream 
with respect to the original conditional branching instruction 
for selec tiou of the fort spot is disci osed on pages 2 , 049-2 , 050 
of Document i mentioned hereinabove. In order to introduce 
Lhe method, a discrimination step for discriminating whether 
or not the fork should be performed depending upon lhe fork 
buuat value should be incorporated at the position immediately 
prior to step 44 or step 76 of the processing of the jjis Liquet ion 
reordering section 23 in the first and second embodiments of 
the present invention. 

The functions and the processes described above of the 
fork spot determination section 21 . register allocation section 
22, instruction reordering section Td t intermediate program 
outputting section 24 and profile information inputting section 
25 of the parallelization Apparatus 11 of the program conversion 
apparatus (compiler) 2 in the first and second embodiments are 
realized by a program executed on a computer . In this instance , 
the program conversion apparatus of the present invention can 
be carried out either by loading the program (of the execute 
form) into a main memory of the computer from a recording medium 
on which the program is recorded such as , for example , a CD-ROM, 
a DVD (digital versatile disk) , a FD (floppy disk) . a HDD (hard 
disk drive) 3 a HT (magnetic tape), or a semiconductor memory 
so that the program is executed by the computer or b> downloading 
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the program onto a HUU or the like of the computer from a server 
or the like through a coannini cation ■ mt ti and installing the 
program into the computer so that the program is executed by 
the computer. 

While prefer rmt uiiluHli—ulg of th* present invent ion have 
been described using specific terms, such description is for 
illustrative purposes only, and it is to be understood that 
changes and variations may be made without departing from the 
spirit or scope of the following claims. 
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